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Abstract 

Since the late 90’s, and based on concepts from graph theory and social sciences, complex networks has grown 
steadily to become a major scientific and technological area. This was, to a good extent, a consequence of the flexibility 
of networks to model virtually every discrete system. Yet, what is a complex network? What does the ‘complex’ in this 
name mean? What are the distinguishing features of complex networks? The present didactic text (CDT-2) addresses 
these key issues in an accessible and integrated manner, and with a few surprises on the way. 


“Frustra fit per plura quod potest fieri per pauciora.’ 

William of Occam. 

1 Introduction 

Simplicity and complexity are the kind of concepts that, 
though difficult to be defined, are immediately recognized 
by most people. One of the few things certain about these 
two terms is that they are opposed: what is complex is 
not simple, and vice versa. So, if we understand one of 
them, there are good chances that we will also understand 
the other. For instance, simple things usually involve a 
few number of concepts and entities (there are exceptions, 
however). Complexity, on the other hand, involves many 
concepts and terms. 

While almost everybody has a good idea of what sim¬ 
plicity and complexity are, several approaches attempt¬ 
ing to derive a more formal and objective definition of 
these terms have failed. The above typical characteris¬ 
tic of complex systems involving more components and 
concepts, for example, has counter-examples. For in¬ 
stance, a gas, with an exceedingly large number of atoms 
or molecules, is ultimately simple because it can be under¬ 
stood in terms of a few concepts and equations from statis¬ 
tical physics. Many other attempts at defining complexity 
have been similarly undermined by counter-examples. 

The area of complex networks can be traced back to the 
late 90’s. While deriving from graph theory (e.g. [1]) and 
previous related developments in social sciences (e.g. [2]), 


complex networks (e.g. [3, 4, 5]) became a major research 
field, mostly thanks to their ability for representing vir¬ 
tually any discrete system, from protein interaction to 
the internet. More recently, the term complex became 
more associated with the own networks, while the area 
that studies these networks is now often called network 
science [6]. 

Despite the importance and broad dissemination of 
complex networks , the ‘complex’ part on its name remains 
a somewhat fuzzy and intriguing concept. In particular, 
what is the difference between a complex network and a 
simple network? Figure 1 illustrates this key question. 
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Figure 1: Are these networks simple or complex? What are the distin¬ 
guishing characteristics of complex networks? 

As discussed above, a possible approach to understand 
the ‘complex’ in complex networks is to identify what sim¬ 
ple networks would be. This is the approach adopted in 
this text. We start by presenting the concepts of graph 
and respective representation by the adjacency matrix, 
as well as its characterization in terms of measurements 
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such as the degree, clustering coefficient and minimal 
path length. Then, regular graphs and uniformly random 
graphs are introduced which we will understand as the 
simple reference against which complex networks can be 
defined. Yet, there will be some surprises along our way, 
surprises deriving from the fact that it is not so simple to 
define simplicity. 


2 Graphs 


Graphs are conceptually very simple, and also very flexi¬ 
ble, data structures involving a set of nodes (or vertices) 
and a set of links (or edges). Figure 2(a) illustrates a 
simple graph containing 7 nodes and 13 edges. 



A = 


0 0 10 10 1 
1 0 0 0 1 0 0 
0 0 0 0 1 0 1 
0 10 0 110 
1 0 0 0 0 1 0 
0 0 0 0 0 0 0 
0 0 0 1 0 0 0 


(a) 


(b) 


Figure 2: Example of a graph (a) and its respective adjacency matrix A 
(b). Each edge going from a node i to a node j is represented by making 
A(j, i) = 1. Whenever there is no connection between i and j, we make 
A(j, i) = 0. 


Observe that the nodes are often identified by respec¬ 
tive numbers, in the case above corresponding to i — 
1, 2,..., 7. Edges can also be labelled in some way, e.g. in 
terms of weights , which can express properties such as 
the distance between nodes. Vertices can also have addi¬ 
tional respectively associated information, for instance to 
convey their dynamic state. 

There are several ways to represent graphs (e.g. [7]), 
but here we will focus on the use of the adjacency ma¬ 
trix. Figure 2 depicts an unweighted graph (a) and its 
respective adjacency matrix A (b). 

The graph in Figure 2 is said to be directed because 
there is ate least one pair of nodes i and j linked in only 
one direction. For instance, there is only an edge going 
from node 5 to 3, and no reciprocating connection from 3 
to 5. In case all edges have their reciprocal, the graph is 
said to be undirected. Observe that this is actually kind 
of a misnomer in the sense that such ‘undirected’ graphs 
are actually two-directed\ 

The number of outgoing connections of a node i is called 
its outdegree out{. Similarly, the number of incoming 
links is the indegree ini of that node. In the case of the 
graph in Figure 2, we have that node 5 has outdegree 


out$ = 5 and indegree in$ = 2. 

Every nodes in an undirected graphs has its outdegree 
identical to its indegree. In these cases, we denominate 
the number of connections of a node simply as degree. 
This measurement can refer to individual nodes, as above, 
and also to the whole network (or portions of it). Mea¬ 
surements derived from the degree commonly employed to 
characterize a whole network usually correspond to statis¬ 
tical quantities such as its average ( k ), standard deviation 
cr, and also the degree density p(k). 

Several other measurements can be used to character¬ 
ize the topological properties of nodes or graphs [4]. Some 
of the simpler and most frequently used include the clus¬ 
tering coefficient which characterizes how interconnected 
are the neighbors of a node, and the minimal path length 
between two nodes, which is self explanatory. Another 
particularly promising possibility is to consider classical 
measurements such as the node degree taken along its 
progressive neighborhoods., or hierarchies (e.g. [8, 4]). 


3 Regular Graphs 

There is an infinite number of different graphs, with vary¬ 
ing sizes and connectivity. One particularly interesting 
type is known as regular graph. Let’s focus our attention 
on undirected regular graphs. These can be easily defined 
as graphs in which all nodes have the same degree. Fig¬ 
ure 3 illustrates a regular graph (a), as well as an ‘almost’ 
regular graph (b). 




(a) 


(b) 


Figure 3: A regular graph (a) sided by an ‘almost’ regular graph (b). 
The graph in (a) presents a toroidal structure. 


While all nodes in the regular graph in Figure 3 have 
the same degree, equal to 4, the ‘almost’ regular graph in 
(b) has some nodes, namely those at its borders, having 
degree smaller than 4. 

Regular graphs are important in our discussion because 
they are very simple in the sense that if one knows the 
degree of one node, all the other degrees will also be re¬ 
vealed. Another way to approach regular graphs is in 
terms the symmetry of its interconnections. Let’s ap¬ 
proach this issue by imagining that we are inside one of 
the graphs of a regular network of degree 4, such as that in 
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Figure 3(a). As we look at the outgoing connections, we 
will count exactly 4 exits. If we decide to move through 
one of these, we will reach another node which also has 4 
exits being, therefore, undistinguishable from the previ¬ 
ous one. And so, on and on, all nodes will look exactly the 
same to someone moving through them! In other words, 
the nodes are undistinguishable - or symmetric - by tak¬ 
ing into account their degree. 

Now, a question arises that is key to many scientific 
problems. It is a question about the completeness of the 
information provided by the node degree of a regular net¬ 
work. Let’s be more specific. The key question here is: is 
it possible to reconstruct a regular graph knowing only the 
degree of its nodes? This is an interesting issue, because 
it would mean that even very large regular graphs (actu¬ 
ally even those with an infinite number of nodes) could 
be completely described only by knowing their number of 
nodes N and the degree of just one of its nodes. Such a 
graph could, without any doubt, be understood as being 
simple. We will return to this puzzling question soon, but 
first we will discuss a kind of graph that is regular in the 
statistical sense. 


4 Uniformly Random Graphs 

After the regular graph discussed in the previous section, 
one of the next type of simplest graphs is the uniformly 
random graph , also known as Erdos-Renyi. These graphs 
are characterized by any of the possible interconnections 
between pairs of nodes having the same probability p to 
exist. Figure 4 illustrates a uniformly random graph with 
N = 300 nodes and (k) =4.5 (a), as well as its respective 
degree distribution p(k) (b). 

As it can be readily appreciated from the degree dis¬ 
tribution p(k), there is some variation of the degree at of 
the nodes of the network. However, a well-defined peak 
arises near the average degree (k). In addition, the dis¬ 
persion around this average is relatively small, with fewer 
and fewer nodes having degrees that are too large or too 
small. For instance, nodes with degree larger than 10 be¬ 
come more and more uncommon (actually, an asymptotic 
decay of the degree density is observed for uniformly ran¬ 
dom graphs). So, if we have to guess the degree of a node 
in this graph, it is a good alternative to chose the aver¬ 
age degree (k). In other words, the topology of the graph 
seems to be well described in terms of its average degree. 

Because the nodes of a uniformly random graph tend to 
have similar degree, it is conceptually interesting to un¬ 
derstand this type of graph as being statistically regular , 
playing an analogous role of regular graphs in the case of 
random graphs. As such, uniformly random graphs can 
be understood to be relatively simple. 



(a) 



k 


(b) 


Figure 4: A uniformly random graph with N = 300 nodes and average 
degree (k) = 4.5 (a), and its respective degree density p(k ) (b). 


At this point, we start referring to graphs also as net¬ 
works, as uniformly random graphs are often treated as 
the simple counterpart of complex networks. 


5 Complex Networks 

We start this section by giving a preliminary answer to 
the question in the name of this text: complex networks 
are graphs that depart substantially from regular or statis¬ 
tically regular graphs (e.g. [9]). Thus, while we can have a 
good idea of the local connectivity of a simple network by 
considering only its degree, more complex networks will 
demand the specification of many more additional respec¬ 
tive properties or features. 

One type of network prototypically understood to be 
complex is the Barabasi-Albert (BA) mode (e.g. [10, 3]). 
Figure 5 illustrates the log-log degree distribution of a BA 
network with N = 10000 nodes and linear preferential 
attachment. 

When mapped in log-log fashion, the degree distribu- 
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Figure 5: The log-log degree distribution of a BA network with N = 
10000 and linear preferential attachment. 


tion of a BA network corresponds to a straight line, imply¬ 
ing a power law relationship between the degree probabil¬ 
ity density and the degree, i.e. p(k) oc k 171 . BA networks 
are a type of scale free network, in the sense that it is im¬ 
possible to identify any differentiating feature along the 
straight line density that can provide a clue about the 
respective degree (understood as scale). 

The key property of the degree densities obtained from 
scale free networks such as the BA model is that they im¬ 
ply in a much broader degree distribution than regular or 
uniformly regular networks. As a consequence, the aver¬ 
age degree no longer describes properly the local topology 
of the network, and we need more information (e.g. the 
whole degree density) in order to have a better idea of 
the network topology. The broader degree distribution 
also allow nodes with particularly high degrees - the so- 
called hubs - to appear. By having degrees that depart 
substantially from those of the other network nodes, hubs 
contribute substantially to breaking the symmetry of the 
network. 

For such reasons, scale free networks have been under¬ 
stood to be complex. Actually, it was mainly the BA 
approach that helped to consolidate the area of complex 
networks. 

At this point, we have an idea of what the ‘complex’ in 
complex networks means, which can be summarized as be¬ 
ing markedly different from regular graphs and uniformly 
random networks or, in other words, requiring substan¬ 
tially more measurements and information so that we can 
have an idea of their local connectivity. However, things 
turn out to be a little bit more complicated, because even 
regular graphs are not guaranteed to be well described by 
their degree. Also, you may have noticed with some cu¬ 
riosity that we have been referring to the degree providing 
a reasonable indication of the local topology or connectiv¬ 
ity of a network. In the next two sections we will discuss 


in more depth why this is so. 

6 Graph Characterization and 
Representation 

Though sometimes unnoticed, there is a subtle distinc¬ 
tion between the concepts of characterization and rep¬ 
resentation (e.g. [11]). To characterize a given object 
means to give some of its properties. For instance, we 
can characterize a book by its size, weight, subject, etc. 
Though telling a lot about the book, these properties or 
features will not be enough for one to reproduce the book 
from them. For that purpose, it would be necessary to 
have much more measurements and information about 
the book, including the transcription of its written con¬ 
tent and the set of eventual figures and diagrams, as well 
as additional measurements of its physical properties. 

Figure 6 illustrates the above distinction between char¬ 
acterization and representation of a given object, namely 
a specific book. The measurements used to describe the 
object are typically represented as a the components of a 
respective feature vector /. 

Characterization: 



(a) 


Representation: 



(b) 


Figure 6: Characterization (a) and representation (b) of an object. A 
book cannot be completely described (single arrow) by the measure¬ 
ments in / 1 , implying in a characterization. Complete description, im¬ 
plying in a representation of the book, can only be eventually achieved 
by using many other measurements /2 allowing the object to be recon¬ 
structed from them (double arrow). 

The special case when an object can be reconstructed 
from a given set of its features characterizes the repre¬ 
sentation of that object. In the case of a given graph, 
the adjacency matrix corresponds to one of the possible 
representations of the original structure, as it allows the 
original graph to be reproduced from its entries. Observe 
that the adjacency matrix can also be understood as a 
set of measurements of the respective graph, consisting of 
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direct measurements of the pairwise node connectivity. 

Mathematically, the mapping of an object into a set 
of respective measurements can be understood as a func¬ 
tion. In case the object can be recovered from the mea¬ 
surements, we have an invertible function , otherwise the 
mapping is non-invertible. Special sets of measurements 
allowing invertible mappings are said to be complete , oth¬ 
erwise they are sometimes called degenerate. 

Quite interestingly, except for representations involving 
large number of measurements (such as the adjacency ma¬ 
trix), it is not currently know which sets of features can 
provide a representation of any given category of graphs. 

7 The Chameleon Paradox 

We are now in position to go back to the interesting ques¬ 
tion we met in Section 3: can a regular graph be recovered 
from its degree k of one of its nodes and the number of 
nodes N? Or, in other words, is the degree (together with 
N) a complete measurement of a regular graph? 

The surprising direct reply is: no. This can be readily 
appreciated by considering the regular graph in Figure 7. 
Even though small, this graph seems to be relatively com¬ 
plex, exhibiting a variety of connectivity patterns (see 
also [9]). However, and surprisingly, every node in this 
graph has the same degree of 4 and, as a consequence, is 
a regular graph! 



Figure 7: The Chameleon Paradox: A regular graph that is complex. 

Though very simple, the graph in Figure 7 provides a 
direct and concluding indicating that even a regular graph 
cannot be well described by its degree. We will refer to this 
remarkable result as the Chameleon paradox. 

The reason behind the chameleon paradox is that reg¬ 
ular graphs are almost invariantly taken to correspond 
to ultra uniform lattice-like structures, such as that in 
Figure 3(a). The nodes in these structures are, indeed, 
fully symmetric whatever measurement is considered. In 
particular, they all have the same degree and clustering 
coefficient, as well as any other property. The fact that 
lattices are fully representable in terms of their size N 
and degree derives from them being lattices , not of be¬ 
ing regular ! That is why the regular graph in Figure 7 is 


not simple: many additional measurements are required 
in order to fully characterize its topology. Contrariwise, 
smaller sets of measurements will, typically, allow only 
the characterization of the respective networks. 

So, we have that most graphs, even those regular or 
uniformly random, are not as simple as they could appear 
at first sight. These results motivate the extension of the 
concept of regular graph to incorporate not only degree, 
but many other measurements [9]. In that way, a new 
understanding to regular graph would require not only 
all nodes to have the same degree, but also any other 
property as well. By doing so, the concepts of regularity 
and simplicity would become closer, and we could say 
that simple networks are those whose nodes (and pairs of 
nodes, etc.) that exhibit the same set of representative 
measurements. 


8 Concluding Remarks 

Complex networks have established themselves as a con¬ 
sequence of their generality for representing virtually any 
discrete system. However, the very concept of ‘complex’ 
on this name is sometimes intriguing. In this work, we 
have addressed the issue of what a complex network is. 
Having characterized regular graphs from the determin¬ 
istic and statistical points of view as graphs whose nodes 
have identical or similar degrees, we argued that the (lo¬ 
cal) topological properties of these graphs can be, to a 
great extent, summarized by their constant degree. 

These considerations on regularity of a network allowed 
us to derive a preliminary answer to the key question in 
this text as: a complex network is a network that is sub¬ 
stantially distinct from a regular graph or uniformly ran¬ 
dom network. However, we then showed that even small 
regular graphs cannot have their topology well described 
in terms of the degree identical to all nodes. This surpris¬ 
ing fact was denominated the Chameleon Paradox. 

This result immediately implies a revision of the con¬ 
cept of graph regularity. In brief, we can only effectively 
associate regularity to simplicity, as a counter-reference 
to complexity, by first extending the regularity concept 
(perhaps as another name) to consider invariance of many 
other relevant measurements. The identification of proper 
sets of such measurements, however, remain an enticing 
research subject because it is not know which set of fea¬ 
tures (other than very large structures such as the adja¬ 
cency matrix) are enough to allow the representation of 
a complex network. 

All in all, in this brief didactic text, we went all the way 
from regular graphs to chameleons to show that it may 
not be so simple to define simplicity, let alone complexity. 
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Costa’s Didactic Texts - CDTs 


This is a Costa’s Didactic Text (CDT). CDTs 
intend to be a halfway point between a formal 
scientific article and a dissemination text in the 
sense that they: (i) explain and illustrate concepts 
in a more informal, graphical and accessible way 
than the average scientific article; and, at the 
same time, (ii) provide more in-depth mathemat¬ 
ical developments than a typical dissemination 
work. 

It is hoped that CDTs can also provide new 
insights and analogies concerning the reported 
concepts and methods. We hope these character¬ 
istics will contribute to making CDTs interesting 
both to beginners as well as to more senior 
researchers. 

Though CDTs are intended primarily for those 
who have some preliminary experience in the 
covered concepts, they can also be useful as 
summary of main topics and concepts to be learnt 
by other readers interested in the respective CDT 
theme. 

Each CDT focuses on a few interrelated concepts. 
Though attempting to be relatively self-contained, 
CDTs tend to be shorter than the average scholar 
article. Links to related material are provided in 
order to complement the covered subjects. 
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